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Abstract 

A general formulation of the Fokker-Planck-Kolmogorov (FPK) equation for stochastic hybrid systems is presented, 
within the framework of Generalized Stochastic Hybrid Systems (GSHS). The FPK equation describes the time evolu- 
tion of the probability law of the hybrid state. Our derivation is based on the concept of mean jump intensity, which is 
related to both the usual stochastic intensity (in the case of spontaneous jumps) and the notion of probability current (in 
the case of forced jumps). This work unifies all previously known instances of the FPK equation for stochastic hybrid 
systems, and provides GSHS practitioners with a tool to derive the correct evolution equation for the probability law 
of the state in any given example. 
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1. Introduction 

Among all continuous-time stochastic models of (nonlinear) dynamical systems, those with the Markov property 
are especially appealUng because of their numerous nice properties. In particular, they come equipped with a pair of 
operator semigroups, the so-called backward and forward semigroups, which are the analytical keys to many prac- 
tical problems involving Markov processes. When the system is determined by a stochastic differential equation, 
these semigroups are generated by Partial Differential Equations (PDE) — respectively the backward and forward 
Kolmogorov equations. The forward Kolmogorov PDE, also known as the Fokker-Planck equation, rules the time 
evolution t ^ nt, where jit is the probability distribution of the state Xt of the system at time t. This paper deals with 
the generalization of this Fokker-Planck-Kolmogorov (FPK) equation to the framework of General Stochastic Hybrid 
Systems (GSHS) recently proposed by Bujorianu and Lygeros |l5l|6|]. 

The GSHS framework encompasses nearly all continuous-time Markov models arising in practical applications, 
including piecewise deterministic Markov processes ||8l|9|] and switching diffusions I15I1 . Two kinds of jumps are 
allowed in a GSHS: spontaneous jumps, defined by a state-dependent stochastic intensity \{Xt), and forced jumps 
triggered by a so-called guard set G. Generalized FPK equations have been given in the literature, in the case of 
spontaneous jumps, for several classes of models; see Gardiner ITsll . Kontorovich and Lyandres iflTll . Krystul et al. 
1 18 1 and Hespanha fT^ for instance. The case of forced jumps is harder to analyze, at the FPK level, because no 



stochastic intensity exists for these jumps. Until recently, the only results available in the literature were dealing with 



one-dimensional models; see Feller 111 IL 11211 and Malhame and Chong 12011 . These results have been extended to a 
class of multi-dimensional models by Beet et al. fl- 

The main contribution of this paper is general formulation of the FPK equation for GSHS's. It is based on the 
concept of mean jump intensity, which conveniently substitutes for the stochastic intensity when the latter does not 
exist. This equation unifies all previously known instances of the FPK equation for stochastic hybrid systems, and 
provides GSHS practitioners with a tool to derive the correct evolution equation for the probability law of the state in 
any given example. The results presented in this paper are extracted from the PhD thesis of the author ||2]- 



"A shorter version of this paper was presented at the 17th IFAC World Congress (IFAC'08) in Seoul, Korea f^. 

*The results presented in this paper come from the PhD thesis of the author \2^, under the supervision of Pr. Gilles Fleury and Dr. Hana Baili. 
Email addresses: julien.bect@supelec.fr (Julien Beet) 
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The paper is organized as follows. Section |2] introduces our notations for the GSHS formalism, together with 
various assumptions that will be needed in the sequel. Section [3] defines the crucial concept of mean jump intensity, 
which is used in Section |4] to derive our unified measure-valued formulation of the generalized FPK equation for 
GSHS's. Section |5] show that the measure-valued equation of Section |4] yields an evolution equation with associated 
boundary conditions in the case where a piecewise smooth exists. Finally, Section|6]concludes the paper with a series 
of examples. 

2. General Stochastic Hybrid Systems 

From the probabilistic point of view, the object of interest in the GSHS formalism is a continuous-time strong 
Markov process X = {Xt)t>o, with values in a metric space It is defined on a filtered space (fi, A, equipped 
with a system {Px', x G E^^ of probability measures on {il, A), with the property that X starts from x under for 
all X G E'^. As usual in the theory of Markov processes, denotes the expectation operator corresponding to P^. 
The reader is referred to |j3,li3.l3l for background information on continuous-time Markov processes. 

It is assumed that, for each w S fi, the samplepath t i-^ Xt{u!) is right-continuous, has left limits X^{uj) in the 
completion E of £^°, and has a finite number of jumps, denoted by Nt{uj), on the interval (0; t] for all t > 0. The 
last condition can be seen as a "pathwise non-Zenoness" requirement. We will denote by the fc* jump time, with 
Tfe = + cxo if there is less than k jumps. 

2.1. The hybrid state space 

The (completed) state-space of the model is assumed to have a hybrid structure: E — U^eg {q] x Eq, where Q 
is a finite or countable set, and each Eq is either the closure of some connected open subset Dq C IR"' (riq > 1) 
or a singleton (in which case we set Uq — 0). The state at time t can therefore be written as a pair Xt = (Qt, Zt), 
where Qt & Q and Zt £ Eq^. We denote by Q"^ = {(7 G Q | = O} the set of all "purely discrete" modes, and by 
E'' = UqfzQd {q} X Eq the corresponding subset of E. The usual definitions for smooth maps and vector fields extend 
without difficulty to such an hybrid structure (see AppendixlAlfor details). 

The state space E is regarded as the disjoint sum of the sets Eq, q E Q, and endowed with the disjoint union 
topologjQ. We denote by £ the Borel cr-algebra, and by £c the subsets of all relatively compact F e Moreover, we 
define a "volume measure" on E by the relation 

m(r)= ^ m5(rn£;,)+ ^ (5,(r), re^:, (i) 

where rriq is the -dimensional Lebesgue measure on Eq and the Dirac mass at x. (Note that Eq C IR"' has been 
tacitly identified with {q} x Eq C E.) 

Let dEq be the boundary of Eq in IR"', with the convention that dEq = when Uq = 0. We define the 
boundary dE of the state space by the relation dE = U^eg {q} x dEq, and the guard set hy G = E \ S". It is not 
required that G — dE. 

Notations. Let /i : £ ^ ]R be a (signed) measure, K : E x £ a kernel and (p : E ^ H a measurable 

function. The following notations will be used throughout the paper, assuming the integrals exist: {iiK){dy) ~ 
J n{dx) K{x, dy), {Kip){x) = / K{x, dy) ip{y) and fJ.(f ^ J fJ.{dx) ip{x). 

2.2. Stochastic differential equation with jumps 

The process X is assumed to be driven by an Ito stochastic differential equation between its jumps: there exist 
r + 1 smooth vector fields f ; and a r-dimensional Wiener process B such that, in mode g G Q \ Q^, 

r 

dZt = h{q,Zt)dt + Y.^i{q,Zt)dB\. (2) 
1=1 



which is (here) locally compact, separable and completely metrizable 
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In other words, for all cp e C'^{E), X satisfies the following generalized Ito formula 



•'^ 1=1 •'^ 0<Tk<t 

where L is the differential generator associated with (|2]i, i.e. 



(3) 



i i,j \l=l / 

We make the following smoothness assumptions: 

Assumption 1. The drift f o is of class C^, and the other vector fields ii, 1 < I < r, are of class C^. 

2.3. Two different kinds of jumps 

We assume that there exists a Markov kernel K from E to E'^ and a measurable locally bounded function X : E'-* ^ 
IR+ , such that the following Levy system identity holds for all x G t > 0, and for all measurable (p : ExE'-* ^ ]R-|_ : 

{ Eo<.,<* ^(^r.,^rj| = y\K^){X-)dHs^ (5) 
where {K(p){y) — J^f, K{y, dy') (p(y, y') and H is the predictable increasing process defined by 



(6) 

Tk<t 

The first part corresponds to 5/?onfa«eoMsjumps, triggered "randomly in time" with a stochastic intensity \{Xt), while 
the other part corresponds to /orcet/ jumps, triggered when X hits the guard set G. 

Remark 2. The terms "spontaneous" and "forced" seem to have been coined by Bujorianu et al. 10] ■ They are closely 
related to the probabilistic notions of predictability and total inaccessibility for stopping times [see, e.g.,|2ll chapter VI, 
§§12-18], but we shall not discuss this point further in this paper 



Remark 3. The pair (A', iJ) is a Levy system for the process X in the sense of Walsh and Weil 11231 definition 6.1] 



Most authors require that El be continuous in the definition of a Levy system, thereby disallowing predictable jumps. 
3. Mean jump intensity 

From now on, we assume that some initial probability law /ip has been chosen, with /io(G) = since the process 
cannot start from G. All expectations will be taken, without further mention, with respect to the probability = 
/ /xo(dx)Pc. 

It is assumed that E{Nt) < + oo. This is a usual requirement for stochastic hybrid processes which is clearly 
stronger than piecewise-continuity of the samplepaths. Its being satisfied depends not only on the dynamics of the 
system but also on the initial probability law ^iq. 

3.L Definition and connection with the usual stochastic intensity 

In order to introduce the main concept of this section, let us define a positive measure Ron E x (0; +oo) by 



(7) 



For any T g£, the quantity R{T x {0;t]) is the expected number of jumps starting from F during the time inter- 
val (0; t]. The measure R is in general unbounded, but its restriction to _E x (0; t] is bounded for alH > because 

E{Nt) < + oo. 



^See, e.g., Davis or Bujorianu andLygeros 
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Definition 4. Suppose that there exists a mapping r : t ^ rt, from [0; +00) to the set of all positive bounded measures 
on E, such that, for all T e £, 

a) 1 1^ rt (r) is measurable, 

b) for all t>0,R{T X {0;t]) = J* r,(r) ds. 

Then r is called the mean jump intensity of the process X (started with the initial law /io)- 

Let us split R into the sum of two measures and i?*^, corresponding respectively to the spontaneous and forced 
jumps of the process. Then, using the Levy system identity, it is easy to see that a mean jump intensity 7-° always exist 
for the spontaneous part it is given by 

r°{r)^E{\{Xt)lx,er) = I^X{x)Mdx). (8) 

In other words: for spontaneous jumps, a mean jump intensity always exists, and it is the expectation of the stochastic 
jump intensity X{Xt) on the event {Xt £ F}. 

Forced jumps are more problematic. The Levy system identity is powerless here, since no stochastic intensity 
exists (because forced jumps are predictable). All hope is not lost, though: a simple example will be presented in 
the next subsection, proving that a mean jump intensity can exist anyway. This is fortunate, since the existence of a 
mean jump intensity will be an essential ingredient for our unified formulation of the generalized FPK equation. See 
subsection l6.2l for further details on that issue. 

3.2. Where fiQ comes into play: an illustrative example 

Consider the following hybrid dynamics on i? = [0; 1]: the state Xt moves to the right at constant speed ?; > as 
long as it is in = [0; 1), and jumps instantaneously to as soon as it hits the guard G — {1} (i.e., the reset kernel 
is such that K{1, ■ ) = (5o). 

If we take /^o = ^0 for the initial law, then the process jumps from 1 to each time t is a multiple of i.e. — 
k/v and — 1 almost surely. There is therefore no mean jump intensity in this case, since R = J2k>i ^(1, k/v)- 

Now take /xq to be the uniform probability on [0; 1] (which is, incidentally, the only stationary probability law of 
the process). Then 

R(rx(0;t]) = (5i(F) / argmaxj^— ^ < tl dx (9) 
Jo k>i [ V j 

= 5i{T) [ Ivt + x'] dx (10) 
Jo 

- vtSiiT), (11) 

where \vt + x] is the smaller integer greater or equal to vt + x. Therefore the mean jump intensity exists in this 
case, and is equal to v 8\ (it is of course time-independent, since pQ is stationary). In particular, the global mean jump 
intensity is rtiE) — v. 



4. Generalized FPK equation 

4.1. A weak form of the FPK equation 

Taking expectations in (O, the following generalized Dynkin formula is obtained: for all compactly supported 
ip G C^iE) andalH > 0, 

E{^{Xt)-^{X^)} = Ei^j^{L^){X,)ds^+E\^Y. ^(^rJ-V'C^-jj. (12) 
Let us assume the existence of a mean jump intensity rt at all times. Then (fT2l) can be rewritten as 

{pt-po)v> = / l^s{Lip)ds+ / rs{K - I)ipds , (13) 
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where /ij is the law of Xt and / is the "identity kernel" on E, i.e. the kernel defined by /(j/, Ay') = 5y{dy'). Formally 
differentiating ( fTSl ) yields 

M; = L*fit + rt{K-T), (14) 

where t /^^ is the time derivative of i i-^ /it (in a sense to be specified later), and L* the "distributional adjoint" 
of L (see AppendixiBlfor a rigorous definition). 

Equation ( fT4l ) begins like the usual Fokker-Planck equation for diffusion processes (fi[ ~ L* ^t) and ends with an 
additional term that accounts for the jumps of the process. 

Definition 5. We will say that t i-^ /it is a solution in the weak sense of the generalized FPK equation for the GSHS 
if 

a) there exists a mean jump intensity t ^ rt, 

b) there exists a mapping t i-^ from [0; +00) to the space M.c{E) of all Radon measures on E, such that 
t ^ /it(r) is absolutely continuous with a.e. -derivative t ^ /^t (F), for all V G £c, 

c) L*/it is a Radon measure for all < > 0, 

d) equation ( fT4l ) holds as an equaUty between Radon measures, i.e. n'^iT) = {L*iJ,t){T) + rt{K — /)(r) for all 
i > and all T e Sc- 

Such a weak form of the FPK equation is the price to pay for a unified treatment of both kind of jumps. Condi- 
tions |5]a]and|5]b]can be seen as smoothness requirements with respect to the time variable, and lS.cl with respect to the 
space variables. 



4.2. "Physical" interpretation 

The usual FPK equation admits a well-known physical interpretation as a conservation equation for the "probability 



mass" [see, e.g.. 11311 . Indeed, assuming the existence of a smooth pdf p G C'^'^{E x IR+), the equation fj,[ — L* jit 



can be rewritten as a conservation equation dpt/dt + div(jt) = 0, with the probability current defined by 

The additional "jump term", in the generalized FPK equation, admits a nice physical interpretation as well. To see 
this, let us rewrite it as the difference of two bounded positive measure: rt{K — I) — rf^ ~ rt, where rf^ — rt.K. 
Therefore rt and rf^"^ behave respectively as a sink and a source in the generalized FPK equation: for each F G 
rt(r) dt is the probability mass leaving the set T during dt, because of the jumps of the process, while rj'''^(r) dt is 
the probability mass entering T. 

These two measures are in fact connected by the reset kernel K{x,dy). In particular, the relation rt{E) = 
j,src j-^-j jjQj(jg ^jj times t > 0, ensuring that the total probability mass is conserved. Moreover, introducing the 
measures Wt{dx,dy) = rt{dx)K{x,dy), we have rt = JW{-,dx), rf'^ — JW{dx, •) and the generalized FPK 
equation can be rewritten more symmetrically as 

fJ-t = Lyt + J iWt{dx,-)-Wti;dx)) . (16) 

It appears clearly, under this form, as a generalization of the differential Chapman-Kolmogorov formula of Gardiner 
ifisl ', equation 3.4.22] — which only allows spontaneous jumps. 



4.3. Sufficient conditions for the existence of a weak solution 

The main result of this paper show that the various requirements of definition |5] are not independent. We denote 
by the total variation measure of a Radon measure v, which is finite on Ec- We shall say that a function t ^ vt 
from [0; 00) to AAc{E) is right-continuous (resp. locally integrable) is i i-^ vt^p is right-continuous (resp. locally 
integrable) for all bounded measurable (/?:£' ^ ]R. 
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Theorem 6. Consider the following assumptions: 

a) there exists a mean jump intensity r ( 15. a I ), such that t ^ rt is right-continuous, 

b) t i—i- i'> dijferentiable in the sense o f\5.b\ t /^J is right-continuous and t locally integrable, 

c) L* fjLt is a Radon measure for allt > liS.ch t i— > L*/it is right-continuous and t ^ \L* \ is locally integrable. 

If any two of these assumptions hold, then the third holds as well and t i-^ Ht is a solution in the weak sense of the 
generalized FPK equation. 

The proof of this theorem is given in Appendix [C] We will not try to give general conditions under which as- 
sumptions I6.al46.cl are satisfied, since such conditions would inevitably be, in the general setting of this paper, very 
complicated (involving the initial law /iq, the vector fields g of the stochastic differential equation, the geometry of 
the state space E and the reset kernel K). 

5. The case when a piecewise smooth pdf exists 

Equation (fl4l i is an evolution equation for the measure-valued function t ^ In many situations of practical 
interest, the measures /if admit a pdf pt, with respect to the volume measure m on E. In this section we show that, if 
the function p : {x, t) ^ Pt{x) is - at least piecewise - smooth, then equation (fT4] l simultaneously gives birth to an 
evolution equation for t ^ pt and to static relations that hold for alH > (so-called "boundary conditions", although 
the name is not entirely appropriate here). 

5.1. Assumptions about the guard and the boundary 

Turning equation (fl4l i into an evolution equation for the pdf utimately boils down to playing with "integration by 
parts" formulas, for judiciously chosen test functions. To do so, we shall need additional assumptions concerning the 
topological regularity of the guard set and the smoothness of the boundary. 

Assumption 7. The guard set G is a regular closed subset of dE (i.e., G is a closed set and it is equal to the closure 
of its interior in dE). 

Assumption 8. For each q € Q such that Uq > 2, the domain Eq is -manifold with comers. 



Assumption [8] is sufficient for the divergence theorem to hold. See Lee 11191 chapter 14] for basic definitions and 
results concerning manifolds with corners. We denote by 5q the surface measure on dEq, and define the surface 
measure s on dE by 

^ = E ^« + E E (17) 

ng>2 nq = l 

We further denote by n the outward-pointing unit normal vector on dE, which is well-defined s-almost everywhere 
on dE. Since the process X is allowed to start on dE \ G, which is a subset of (see Section |2]i, the vector fields 
have to satisfy the following conditions (on the smooth part of dE \ G, hence 5-almost everywhere): 

(fo,n)<0, and (f/, n) = , 1 < ^ < r . (18) 

Otherwise, for any (g, x) G dE \ G, the solution of equation (O would leave the domain "instantaneously" (i.e. almost 
surely in any time neighborhood of 0). 

5.2. Connecting the mean intensity of forced jumps with the probability current (local result) 

Let G*^ denote the subset of the guard set G where at least one of the "noise" vector fields is not tangent to the 
boundary, i.e. G" — {a; G G, 3/ £ {1, . . . , r}, (f/, n) ^ 0}. The following results relates the mean intensity of 
forced jumps with the probability current jj defined by equation (flST l. 

Proposition 9. Assume that the measures fj,t admit a pdfpt — p{ - ,t) for allt>0 on some open subset U <Z E, with 
p e G'^'^{U X 1R+). Define the outward probability current — (j^ , n) o« [/ fl G. Then, for all t >Q, 
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<2j — '^^'^ ^t^i^) — Jr ^'^^ mean intensity of forced jumps onU DG, 

b) the pdfpt vanishes onU D G". 

See Appendix ID] for the proof. This proposition provides two important conclusions concerning forced jumps. 
The first one is that, when a smooth pdf exists in a neighborhood of the guard set, the mean intensity of forced jumps 
(which appears in the FPK equation) is equal to the outward flow of the probability current. This is consistent with 
the physical interpretation of the probability current: jjds dt is the probability mass ("number of particles") escaping 
from the domain through ds during dt. 

The second conclusion is that the familiar "absorbing boundary" condition pt — holds on the guard set as soon 
as one of the "noise" vector fields is active in the normal direction. Note that the pdf does not vanish on the boundary 
in example of subsection l3.2l which is a piecewise deterministic process with forced jumps. 



5.3. Evolution equation for the pdf and "boundary" conditions (global result) 

The local result of subsection 15.21 will now be used to obtain a general formulation of the FPK equation (fl4l l in 
terms of a probability density function, when one exists and is smooth enough. Let H C E'^\E'^hea closed set 
of m-measure zero - typically, H will be a closed hypersurface in applications. Note that U = E \ H is an open 
neighborhood of the boundary dE. Assume now that the following holds: 

Assumption 10. a) fxt admits a pdfpt with respect to m, on the whole state space, for all t>Q, 

b) p ^ C"^'^ {U X ]R+), with ^ and Fp locally integrable on E x ]R+. 
Then the divergence theorem, together with condition ( fTsT i and proposition l9.bl yield that (see AppendixlBl) 

{L*fit)^ ^ f Fpt if dm + f j™Vds, (19) 

JE JdE 

for all if e C^ (U), where F is the formal adjoint of L, i.e., the differential operator defined by 

The (possible) lack of differentiability of pt on H therefore translates into the fact that the Radon measures (3t, 

fitiV) ^ I Fptdm + [ j°"'ds - (L*/iO(r). (21) 

Jt JdEnT 

do not vanish in general. This, in turn, is closely related to the existence of a non-vanishing m-singular part in the 
source term rf^ — rtK, as stated by the following result. 

Theorem 11. Let Assumption ITOl hold. Then the conditions I6.al46xl of Theorem l6l are satisfied, and the following 
evolution equation holds on E^ \ H, for all t > 0: 

dp d{rtK) 

— ^ Fpt^ Xpt ■ (22) 

ot dm 

Moreover, according to Proposition^ 

a) ?'p(r) = Jj^^^ ds is the mean intensity of forced jumps, 

b) and the absorbing boundary condition, pt — 0, holds on 

Finally, the m-singular part (rtK)-^ of rtK is supported by the set H U {dE \ G) and satisfies the following "conser- 
vation equations" : 

c) (nK)^ ^Pt>OonH, 

d) [rtK)^ = - I. jT* ds > on dE\ G. 
See Appendix|E]for the proof. 
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6.1. A class of models with spontaneous jumps 

Our first series of examples covers a large family of models without forced jumps (G — 0). The reset kernel K is 
assumed to satisfy the following assumption: 

Assumption 12. There exists a kernel K* on E such that 

m{Ax)K{x,Ay) ^m{dy)K*{y,dx) . (23) 

(We do not assume that K* is a Markov kernel, i.e. that K*{y, •) is a probability measure.) The following result is an 
easy consequence of Theorem|6] 

Corollary 13. If there exists a pdfp G C'^'^{E x 1R+), then the measures rt and rf^ are absolutely continuous with 
respect to m, 

^ = Apt , = K* (Xpt) , (24) 

and the following evolution equation holds: 

^ - L*pt + K*{\pt) - Xpt. (25) 

Assumption[T2]holds for several classes of models known in the hterature: pure jump processes with an absolutely 
continuous reset kernel, the switching diffusions of Ghosh et al. iflsifTill and also the SHS of Hespanha lfl6ll . 

Example 14. Pure jump processes occur when L ~ i.e. when there is no continuous dynamics. We consider here 
the case where K is absolutely continuous: K{x, dy) — k{x, y) m{dy). For instance, if the amplitude of the jumps 
is independent of the pre-jump state and distributed the pdf p, then k{x, y) = p{y — x). In this case Assumption [T2] 
holds with K*{x, dy) = k{y.^x)m{dy). Introducing the function 7(2;, y) = \{x)k{x, y), equation |25] turns into the 
well-known master equation 11131 eq. 3.5.2]: 

■^(2/;*)= {l(x:y)p{x, t) - j{y,x)p{y,t)) m{dx) . (26) 

In particular, when all modes are purely discrete (uq = 0), this is just the usual forward Kolmogorov equation for a 
continuous-time Markov chain. 

Example 15. In the case of switching diffusions, the state space is of the form E — Q x R" (with Q a countable set 
and n > 1) and the reset kernel of the form 

K{{q,z),-) = ^ TTqq, (z) (5(^,_^) , (27) 

where Tr{z) = [T^qq' {z)) is a stochastic matrix for all z E M". Assumption fT2lis fulfilled with K* defined by 

K*{{q,z),-) = J2 V9W^(9',.)- (28) 

Equation [T3] becomes in this case the familiar generalized FPK equation for switching diffusion processes [see, e.g., 
\m\l^-- for all x={q,z) EE and t > 0, 

^ix,t) = (L*pt){x) + K'q{z)pt{q',z) - X{x)pt{x), (29) 

9' 7^9 



where \q'q{z) = \{q' , z) 7r,',(z). 
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Example 16. The SHS of Hespanha III6II are also defined on = Q x R", but this time the post-jump state Xr^ is 
determined by applying a reset map : E ^ to the pre-jump state X~^, being chosen randomly in a finite of 
reset maps '^k- The reset kernel can therefore be written as 

K{x,-) = ^ Trk{x)5yi,^,^^) , (30) 
fe 

with TTfe {x) the probability of choosing the reset map vj/ j. given that = x. Provided that the functions are local 
C^-diffeomorphisms, the kernel K fulfills AssumptionfT2lwith 

K*{x,-)^Y1 E ^k{y)\Jk{y)\''Sy, (31) 

where Jk{y) is the Jacobian determinant of 'i'k at y. Therefore, introducing a stochastic intensity = Xgk for 
each one of the reset maps, we recover thanks to Corollary [T3]the generaUzed FPK equation given by Hespanha iflii 
p. 1364]: 

^^ix,t) = (L*pO(^)+E E (^(y) -(A/cft)(^)) ■ (32) 

6.2. A class of models with forced jumps 

The measure-valued formulation of the generalized FPK equation ( fT4l i paves the way for an easier proof of some 
recent results concerning GSHS with forced jumps and deterministic resets. A typical example of this class of 
process is the thermostat model of Malhame and Chong |20], which has been extended to several dimensions in Jst). 
We consider the class of GSHS models satisfying the following assumptions. 

Assumption 17. a) The model only has forced jumps (\ = Q) with deterministic resets, i.e. there exists a map 
^E* : G — > E^ such that K{x, • ) = S^i^^^for all x G G. 

b) All modes have the same dimension Ug — n, the guard set is the whole boundary (G ^ dE) and is of class 
(in particular, it has no comers). 

c) H = ^'(G) is a hypersurface, closed in E, and ^ is a C^-diffeomorphismfrom G to H. 

The assumption that G = dE is only here for the sake of simplicity and could easily be relaxed. Boundaries with 
corners and piecewise smooth reset maps could be considered as well. The model considered in [3] also includes 
purely discrete modes (i.e., Uq £ {0, n} for each q G Q), which cause no real additional difficulty. 

The measure if (x, • ) is supported by H for all x, which implies that the source term rtK is also supported by H, 
hence is m-singular. Therefore, even if the diffusion is non-degenerate (i.e. the diffusion matrix [a^^) is uniformly 
positive definite), we know from subsection 15 . 3 1 that the pdf pt will not be smooth on H. Accordingly, we make the 
following smoothness assumption for the measures jit'. 

Assumption 18. a) fit admits a pdf pt with respect to m on the whole state space, for all t > 0, 

b) p G G^'^ {{E \ H) X R+), pt and Vpt have at most a jump discontinuity (discontinuity of the first kind) on H. 

Then Assumption [TO] hold, which allows Proposition [TT] to be applied. In particular, easy computations with the 
divergence theorem (similar to those in AppendixlBl) yield that, for all (p E C'^ (E), 

{L*fit)v = I Fpt ^ dm + [ jrVds - / jtVds -IY^I f/^ (f/,nafc) {p\ ~ p1) Abh , (33) 

J E JG Jh ^ Jh 

where Uab is the unit normal vector on H oriented from side a to side b and jj" = ^j^^' — jj"' , riah). The superscripts 
a/b indicate the value of a discontinuous function on the corresponding side of H (but none of these quantities actually 
depend on the chosen labelling of the sides). The last term on the right-hand side vanishes, because L*^t is a Radon 
measure by Theorem|6] Therefore, pt is continuous on H and the measures Pt of Theorem[TT]are given by 



A(r) = / j7d5. (34) 

J Hnr 

The conclusions of propositionfTTIcan then be summarized as follows: 
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a) The usual Fokker- Planck equation, dpt/dt — Fpt, holds on each component of \H 

b) The conservation probability current through the reset map is ensured by the relation 

where o 'I' is the pushforward (image measure) of by ^P^^. 

c) The absorbing boundary condition, pt = 0, holds on G". 
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A. Smooth maps and vector fields on E 

The following definitions are natural extensions to the hybrid state space E of the usual definition on subsets 
ofR". 

A map : _E ^ ]R is said to be fc-times continuously differentiable on i? — in short, Lp <^ (E) — if fq = 
(p{q, ■ ) is C'' on Eg in the usual sense for all g G Q \ Q'^, i.e. if there is an open subset U of R"' such that Eg C U 
and ip extends to a C*^ map on U. 



Page lOATl] 



(35) 
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A vector field g on i? is defined as a first order differential operator with respect to the continuous variables. Its 
action on a continuously differentiable function ip G C^{E) will be denoted by gip, where 

.) 4^"- f '"ly"- (36. 

\gip — on E . 

The number of "components" of g depends on the mode q. To simplify the notations, we shall agree that the indexes i 
and j always correspond to summations on the number of continuous variables, and drop the explicit dependence on q. 
For instance, the definition of gip on E \ E"^ can be rewritten as gip — ^ - g*^- A vector field is said to be fc-times 
continuously differentiable on E if g*(<7, • ) is C'^ on Eg in the usual sense for all q e Q \ and alH G {1, . . . , n J. 



B. The operator L* 

The operator L* introduced in Section|4]is defined over the set Aic{E) of all Radon measures on E as the "adjoint" 
of the differential generator L (see equation (|4]i): 

iL*iy)icp) = i^iLif) = f {Lip){x)iyidx), ycpeC^iE). (37) 

JE 

As a consequence of Assumption[T] the result L*!^ of applying L* to a Radon measure h' is, in general, a second order 
distribution. It is important to note that, because the state space E has a boundary dE, the operator L* is not a simple 
second order partial differential operator - it also includes "boundary terms". 

Under Assumption|8] the following version of the divergence theorem - which is a multidimensional generalization 
of the "integration by parts" formula - is the key tool to compute L*^ for Radon measures with a smooth density. 

Theorem 19 (see, e.g., [19]). Let Assumption\8\ Then, for all compactly supported vector field f on E, 

I div(f ) dm = / (f , n) ds . (38) 

JE JdE 

Let U be an open subset of E. Assume that /if has a smooth density pt on U. Simple manipulations of equations 
and (O yield that 

L(ppt ^ jt(p+^^div{iiipptii) . (39) 

Moreover, using the product rule for the divergence operator: 

JtVs = div((/7jt) - ip div(jt) = div((/3jj + (p Fpt , (40) 

where F is the Fokker-Planck operator as in Section 15.31 Therefore, using the divergence theorem to compute the 
integral of the divergence terms in ( |39] l and (l40b . we get: 

(L*A*f)M = / Lip Pt dm ^ f ip Fpt dm + f ^jT'ds+^V/ fiippt {fi,n) ds . (41) 

JE JE JdE ^ , JdE 



C. Proof of Theorem |6] 

Let C'^{E) denote the set of all compactly supported ip G C'^{E). The following lemma is an easy consequence 
of the smoothness of the vector fields: 

Lemma 20. For all p G C'^{E), t i— > J^(L* iis)i'p) ds is differentiable on the right, with the right continuous 
derivative t >— > {L* fit){f)- 



/ Beet / Nonlinear Analysis: Hybrid Systems / Draft, January 6, 2009 



Page 12 475] 



In the sequel, "right continuous" is abbreviated as "rc". 

o Assume that both l6.al and l6.bl hold. Then each term of ( fT3] ) has a t-derivative on the right. Differentiating both 
sides proves that (fl4] i holds for all i > 0, hence that L*iit is a Radon measure and that t ^ L*nt is rc. Moreover, 
integrating the inequality < l/i^l + 2rj yields that, for all F e £c, 

f \L*fis\{T)ds< f Ifi'J {r)ds + 2 E{Nt} <+oo. (42) 
Jo Jo 



Therefore t \L*fis \ is locally integrable, which proves 16x1 

o Assume now that l6.afa nd l6.ch old. and set /ij = L*fit + Vt {K — /), for all t > 0. Clearly, /zj is a Radon measure, 
i 1-^ /ij is rc and 



t 



^lW={^it- ^io)'P: vt>o, y^eCliE). (43) 

Jo 

Moreover, for all Y ^ £c, 

f |M'J(r)ds< / |L>,|(r)ds + 2£;{7Vt} < +00, (44) 

Jo Jo 

which shows that 1 1— > \fj,'J is locally integrable. Therefore, using standard approximation techniques and a monotone 
class argument, it can be proved that ( |43] | still holds for ip — Ir, T G £c, i.e. that 1 1— > /ij is the "derivative" oft ^ Ht 
in the sense of definition lS.bl 

o Finally, assume that l6.bl and l6.cl hold. Then, for all Lp G C'^{E), equation ( fTSl ) can be rewritten as 

(p{x) {R^{dx,ds) ~ {L*n,){dx)ds) ^ jj ip{x) {{R^K){dx,ds)~^s{'^x)ds) , (45) 

Gx]0;t] SOx]0:t] 

where = Ms ~ {L* fXs) {E^ n • ) — r^{K—I). The measures R'-^ and r° have been defined in subsection l3.1l Clearly, 
€ A4c(i') and i i— s- is locally integrable. Using once more standard approximation techniques, one can prove 
that ( l45T l still holds when (/? = Ir, with T a compact subset of G. In this case the right-hand side vanishes, yielding 

i?<=(rx]0;<]) - / (LVs)(r)ds. (46) 
Jo 

Moreover, since t ^ i?"-^(rx]0; t]) is increasing and t ^ {L*fit)(r) is rc, we have {L*fit)(r) > for all t > 0. 
This allows to extend ( l45T l to all F G £c, using a monotone class argument, thus proving the existence of a mean jump 
intensity — {L*fis)iG fl • ) for the forced jumps. 



D. Proof of Proposition |9] 

Since p is of class C^'^ on U x ]R+, it is easily seen that the assertions I6.bl and 16. cl hold on U. Using the same 
arguments as in the proof of Theorem|6] it follows that 16. al and the generalized FPK equation hold on U as well. 

Let V — (9£^)stnooth where {dE)^^^^^^ denote the smooth part of the boundary. V is an open subset of dE. 
For each 77 G C^{V), there exists a sequence of functions G C^{U), with their support in a fixed compact set, 
such that ipn = and dipn/dn — rjonV, and — > uniformly. Equation dTTT l holds for each n. Taking limits 
with respect to n on both sides, and using the fact that {L* ^t) {^n) ~^ (since L* is a Radon measure on U), we 
find that J^i Jqe VPt {^i ,^) ds = 0. Therefore, x 1-^ p{x, t) J^i i^U^) vanishes s-almost everywhere on V, hence 
everywhere on dE by continuity. This proves assertion l9.bl since J2i (ffi J^)^ > on G°. 

Using ( |4T1 ) and |9.b| the Radon measure L* /.it can be rewritten as 

{L*^lt){T) ^ f Fpt dm + f jT'ds (47) 
Jr JdEnT 

for all F G £c such that F C C/, and the generalized FPK equation (fT4l i on U now reads as follows: 

(F) = [ Fpt dm + [ jT* ds + n {K - /) (F) . (48) 

Jr JdEnv 

Identifying the terms that are supported by G D [/ yields rfiV n C/) = /pp^j ds for all F G £c- Therefore is 
positive s-almost everywhere on F n [/, hence everywhere by continuity. This proves assertion |9.a| 
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E. Proof of TheoremlTT] 

The assumption l6.bl of Theorem |6] holds with /x'(r) ~ Jp since ^ exists m-almost everywhere and is locally 
bounded. Moreover, as in the proof of Proposition|9] the existence of on G n J7 = G follows from the fact that l6.bl 
and 16. c I hold on U. We have thus proved that the assumptions 16. al (existence of rj) and l6.bl of Theorem l6l (existence 
of /x') hold on the whole state space, which implies that l6. el and the generalized FPK equation (fT4] l hold as well. 

As a consequence of equation $4T\ . we have 



(LVt)(rnC/) = / Fpt dm + / ird5 = Fpt dm + / j^' ds (49) 

Jrnu JdEnmu Jr JdEnr 

for all r e fc, since m(£; c J7) = and dE C U. Equation (EB thus simphfies into /3t(r) = - (i*Mt) (r n H), 
which proves that the measures Pt are supported by H. 

According to ( |49] l, the generalized FPK equation ( fT4l ) can be decomposed as 



^l'^{T) = f Fptdm+ f jT' ds + (T n i?) + n{K - I){T) . 

Jr JdEnr 

Unicity of the Radon-Nikodym decomposition (with respect to m) yields the following pair of equations: 



(50) 



dp djrtK) 

— = Fpt H — \pt , (51) 

= / ds + {TnH) + inK) (r) - (rf) (r) , (52) 

JdEnr 

where we have used that dr^ — Ad/it . The first equation is precisely (l22l) . and the second one splits into lll.cl 
(respectively ! 1 1 .dl l by considering the terms that are supported by H (respectively dE \ G). 



